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INTRODIJCTTON 


The  following  is  a  complete  listing,  as  of  this  date,  of  Schneidewind  Software  Reliability  Model 
equations  and  Schneidewind  Software  Metrics  Model  equations  divided  into  tool  implementation  categories 
(i.e.,  SMERFS,  Statgraphics,  Defect  Control  System  Database,  and  Windows  Calculator).  The  purpose  is  to 
show  which  equations  are  implemented  in  which  tool.  The  list  is  divided  as  follows: 

0  SOFTWARE  RELIABILITY  MODEL  EQUATIONS 

-  NOTATION 

-  EQUATIONS  IMPLEMENTED  IN  SMERFS 

-  EQUATIONS  IMPLEMENTED  IN  STATGRAPHICS 

*  TABLE  1 

o  DISTRIBUTED  SYSTEM  MODEL  EQUATIONS 

-  NOTATION 

-  EQUATIONS  IMPLEMENTED  USING  DEFECT  CONTROL  SYSTEM  DATABASE 

-  EQUATIONS  IMPLEMENTED  USING  WINDOWS  CALCULATOR 

-  EQUATIONS  IMPLEMENTED  IN  STATGRAPHICS 

*  TABLE  2 

-  EQUATION  IMPLEMENTED  IN  SMERFS 
o  METRICS  MODELS  EQUATIONS 

-  DISCRIMINATIVE  POWER  VALIDATION  MODEL 

*  NOTATION 

*  EQUATIONS  IMPLEMENTED  IN  STATGRAPHICS 

*  EQUATION  IMPLEMENTED  USING  WINDOWS  CALCULATOR 

**  TABLE  3 

-  PREDICTABILITY  VALIDATION  MODEL 

*  NOTATION 

*  EQUATIONS  IMPLEMENTED  IN  STATGRAPHICS 

** TABLE  4 

The  reason  for  TABLES  1...4  is  that  the  syntax  of  the  STATGRAPHICS  equation  editor  does  not 
correspond  identically  to  that  in  the  equation  notation  (e.g.,  no  Greek  symbols,  subscripts,  and  superscripts 
available).  Also  the  limited  space  available  for  a  STATGRAPHICS  equation  definition  does  not  always  allow 
these  definitions  to  be  identical  to  the  mathematical  definitions.  Thus  in  order  to  use  the  STATGRAPHICS 
package,  it  is  necessary  to  see  the  equations  as  they  are  written,  using  its  syntax.  The  tables  define  the  syntax. 
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SOFTWARE  RELIABILITY  MODEL  EQUATIONS 


NOTATION 

a  failure  rate  at  the  beginning  of  interval  s 

P  negative  of  derivative  of  failure  rate  divided  by  failure  rate  (i.e.,  relative  failure  rate) 

F(i)  predicted  failure  count  in  the  range  [1  ,i];  used  in  computing  MSE^ 

Fjj  observed  failure  coimt  during  interval  j  since  interval  i;  used  in  computing  MSE^ 

F(t)  predicted  failure  count  in  the  range  [1 ,  t] 

F,  given  number  of  failures  to  occur  after  interval  t;  used  in  predicting  Tp(t) 

F(ti»t2)  predicted  failure  count  in  the  range  [tjjtj] 

F(«)  predicted  failure  count  in  the  range  [1  ,co];  maximum  failures  over  the  life  of  the  software 

i  current  interval 

j  next  interval  j>i  where  Fij>0 

J  maximum  j  <t  where  Fij>0 

MSEp  mean  square  error  criterion  for  selecting  s  for  failure  count  predictions 

MSEr  mean  square  error  criterion  for  selecting  s  for  remaining  failure  predictions 

MSEp  mean  square  error  criterion  for  selecting  s  for  time  to  next  failure  predictions 

p(t)  fraction  of  remaining  failures  predicted  at  time  t 

Q(t)  operational  quality  predicted  at  time  t;  the  complement  of  p(t);  the  degree  to  which  software  is 
free  of  remaining  faults  (failures) 

r^  critical  value  of  remaining  failures;  used  in  computing  RCM  r(tj) 

r(t)  remaining  failures  predicted  at  time  t 

r(t^  remaining  failures  predicted  at  total  test  time  tj 

Ar(Tp,t;  reduction  in  remaining  failures  that  would  be  achieved  if  the  software  were  executed  for  a  time 
Tp,  predicted  at  time  t 

RCM  r(tt)  risk  criterion  metric  for  remaining  failures  at  total  test  time  t, 

RCM  TF(t^  risk  criterion  metric  for  time  to  next  failure  at  total  test  time  t, 
s  starting  interval  for  using  observed  failure  data  in  parameter  estimation 

s*  optimal  starting  interval  for  using  observed  failure  data,  as  determined  by  MSE  criterion 

t  cumulative  time  in  the  range  [l,t];  last  interval  of  observed  failure  data;  current  interval 

tn,  mission  duration  (end  time-start  time);  used  in  computing  RCM  Tp(tL) 
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t,  total  test  time  (observed  or  predicted) 

TF(t)  time  to  next  faiiure(s)  predicted  at  time  t 

Tp(tt)  time  to  next  failure  predicted  at  total  test  time  tt 

TF(Ar,t)  time  to  next  N  failures  that  would  be  achieved  if  remaining  failures  were  reduced  by  Ar,  predicted 
at  time  t 

Tjj  time  since  interval  i  to  observe  number  of  failures  Fjj  during  interval  j;  used  in  computing  MSEp 

Xj.  number  of  observed  failures  in  interval  k 

Xj  observed  failure  count  in  the  range  [1  ,i] 

Xj.  1  observed  failure  count  in  the  range  [  1  ,s- 1  ] 

Xj  i  observed  failure  count  in  the  range  [i,s- 1  ] 

Xj  i  observed  failure  count  in  the  range  [s,i] 

Xj  t  observed  failure  count  in  the  range  [s,t] 

Xj  „  observed  failure  count  in  the  range  [s,t]] 

Xj  observed  failure  count  in  the  range  [  1  ,t] 

X,,  observed  failure  coimt  in  the  range  [1  ,t,] 

EQUATIONS  TMPT.EMENTED  TN  SMERFS 

Parameter  Estimation 

The  log  of  the  likelihood  function  is: 

log  L-X,[log  X,-l-log(l-exp(-pt))].X^,[Iog(l-exp(-P(s-l)))] 

.X^.[log(l-exp(-  P))]-pi:  (s.k-l)x 

k-O 


This  function  is  used  to  derive  the  equations  for  estimating  a  and  p  for  each  of  the  three  methods.  In  the 
equations  that  follow,  a  and  P  are  estimates  of  the  population  parameters. 

Method  1 

Use  all  of  the  failure  counts  from  interval  1  through  t  (s=l).  This  method  is  used  if  it  is  assumed  that  all  of 
the  historical  failure  counts  from  1  through  t  are  representative  of  the  future  failure  process.  The  following 
two  equations  are  used  to  estimate  P  and  a,  respectively. 

exp(p)-l  exp(pt)-l  M  X, 
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px, 

l-exp(-pt) 


Method  2 

Use  failure  counts  only  in  the  intervals  s  through  t  (1  <s^t).  This  method  is  used  if  it  is  assumed  that  only 
the  historical  failure  counts  from  s  through  t  are  representative  of  the  future  failure  process.  The  following 
two  equations  are  used  to  estimate  p  and  a,  respectively. 

1 _ t-sA 

exp(p)-l  exp(p(t-sU))-r^  X^, 


a= 


l-exp(-P(t-s+l)) 


Method  2  is  equivalent  to  Method  1  for  s=l. 

Method  3 

Use  the  cumulative  failure  count  in  the  interval  1  through  s-1  and  individual  failure  counts  in  the  intervals 
s  through  t  (2<s<t).  This  method  is  used  if  it  is  assumed  that  the  historical  cumulative  failure  count  from  1 
through  s-1  and  the  individual  failure  coxmts  from  s  through  t  are  representative  of  the  future  failure  process. 
This  method  is  intermediate  to  Method  1,  which  uses  all  the  data,  and  Method  2,  which  discards  "old"  data. 
The  following  two  equations  are  used  to  estimate  p  and  a,  respectively. 


(s-DX^,  X,  tX,  ^ 
exp(P(s-l))-l  exp(P)-l  exp(Pt)-l  ^ 


(s+k-l)x^^ 


PX, 

l-e3q3(-pt) 

Method  3  is  equivalent  to  Method  1  for  s=2. 

Failures  in  an  Interval  Range 
Predicted  failure  count  in  the  range  [tj,t2\  '. 

F(t„t2)=(a/p)[l-exp(-p((Vs+l)))]-X3,., 

Maximum  Failures 

Predicted  failure  count  in  the  range  [1,'^]  (i.e.,  maximum  failures  over  the  life  of  the  software): 
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F(o=)=a/p+X,., 


(Note:  Implemented  in  SMERFS  but  the  user  must  make  the  manual  correction  of  adding  Xj.;  to  the  quantity 
a/p  that  SMERFS  computes). 

Remaining  Failures 

Predicted  remaining  failures  r(t)  at  time  t: 
r(t)=(a/p)-X3,=F(co)-X, 

(Note:  Implemented  in  SMERFS  but  the  user  must  make  the  manual  correction  of  adding  X,.,  to  the  quantity 
a/p-X,  that  SMERFS  computes). 

Time  to  Next  Failure 


Predicted  time  for  the  next  F,  failures  to  occur,  when  the  current  time  is  t: 
T,(t)=[aog[a/(a-p(X^.F,)])/p]-(t-s.l) 

for  (a/p)>(X^  .F,) 


Mean  Square  Error  Criterion  for  Remaining  Failures.  Maximum  Failures,  and  Total  Test  Time  (For 
Method  2  and  Method  1 

Mean  Square  Error  (MSE^)  criterion  for  number  of  remaining  failures,  etc.: 

E[F(i)-Xr 

MSE=-/:^ - 

^  t-s-1 


where 

F(i)=(a/p)[l-exp(-p((i-s+l)))]+X,., 

Mean  Square  Error  Criterion  for  Time  to  Next  Failurefsl  (For  Method  2  and  Method  1  (s=IS\ 

Mean  Square  Error  criterion  for  time  to  next  failure(s): 

X:[[log[a/(a-P(X^..Fp)]/p-(i-s.l)]-T.r 
^  (J-s) 

for  (a/p)>(X^>Fp 
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EQUATIONS  IMPLEMENTED  TN  STATGRAPHICS 


Cumulative  Failures 

Predicted  failure  count  in  the  range  [1,  t]: 

F(t)=(a/P)[l-exp(-p((t-s+l)))]+X,., 

Remaining  Failures 

Predicted  remaining  failures  as  a  function  of  total  test  time  t,: 
r(tt)=(a/p)(exp-  p  [V(s- 1)]) 

Fraction  of  Remaining  Failures  : 

Fraction  of  remaining  failures  predicted  at  time  t: 
p(t)=r(t)/F(~) 

Operational  Quality 

Operational  quality  predicted  at  time  t: 

Q(t)=l-P(t) 

Total  Test  Time  to  Achieve  Specified  Remaining  Failures 

Predicted  total  test  time  required  to  achieve  a  specified  number  of  remaining  failures  at  t,,  r(tt): 
t,=[log[o/(P[r(t.)])]]/p<s-l) 

Time  to  Next  N  Failures  and  Remaining  Failures  Tradeoffs 

Time  to  next  N failures  that  would  be  achieved  if  remaining  failures  were  reduced  by  at,  predicted  at  time 
TF(Ar,t;=(-l/p)[log[l-((PAr/a)(exp(p(t-s+l))))]] 

for  ((PAr/cc)(exp(P(t-s+l  ))))<!. 

Reduction  in  remaining  failures  that  would  be  achieved  if  the  software  were  executed  for  a  time  Tp  predicted 
at  time  t: 

Ar(TF,t)=(a/  p  )[exp(-  p  (t-s+ 1 ))]  [  1  -exp(-  p  (Tf))] 

Mean  Square  Error  Criterion  for  Failure  Counts  (For  Method  2  and  Method  1 

Mean  Square  Error  criterion  for  failure  counts: 
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MSEp= 


E 


[a/p(l-exp(-P(i-s.l)))-X/ 

t-s+1 


Criteria  for  Safety 


1)  predicted  remaining  failures  r(tt)<rc, 
where  r^  is  a  specified  critical  value ,  and 

2)  predicted  time  to  next  failure  TF(tJ>tn„ 
where  t^,  is  mission  duration. 

Risk  Assessment 

Risk  criterion  metric  for  remaining  failures  at  total  test  time  t,: 

RCM  r(g=  (r(g-rj/r  =(r(g/re)-l 

Risk  criterion  metric  for  time  to  next  failure  at  total  test  time  t,: 

RCM  TF(g=(VTF(Oyt™=l-(Tp(g)/tn, 

Note:  Although  Criteria  for  Safety  and  Risk  Assessment  equations  are  not  covered  in  the  other  volumes  of 
the  handbook,  they  are  listed  here  because  they  are  part  of  the  Schneidewind  Software  Reliability  Model. 
These  items  are  covered  in:  Norman  F.  Schneidewind^  "Reliability  Modeling  for  Safety  Critical  Software", 
IEEE  Transactions  on  Reliability,  Vol.  46,  No.l,  March  1997,  pp.88-98. 
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TABLE  1:  STATGRAPHICS  (SGPLUS)  EQUATION  IMPLEMENTATIONS 
SOFTWARE  RELIABILITY  MODEL  EQUATIONS 

Math 

Notation 

Sgplus 

Notation 

Statgraphics  Definition 

Sgplus  Function 

a 

alpha 

Beginning  failure  rate 

From  SMERFS 

p 

beta 

Relative  failure  rate 

From  SMERFS 

AI 

deltaR 

Delta  Remaining  Failures 

Given  value 

f(t) 

d 

Predicted  Failure  Rate 

(alpha)*(EXP(-(beta*(i-(s- 1 ))))) 

F(i) 

f 

Predicted  Cumulative 
Failures 

((alpha/beta)*(l-EXP((-beta)*((i-s)+l))))+Xs 

Fy 

Fij 

Number  of  failures  at  j 
since  i  in  MSEtf 

From  failure  data 

Ft 

Fij 

Number  of  failures  to 
occur  after  interval  t  in  tf 

Given  value 

F(t) 

Ft 

Predicted  Maximum 
Failures 

(alpha/beta)+(Xs) 

i 

i 

Execution  time  index 

From  failure  data 

j 

j 

Maximum  j  ^t  where 

Fij>0 

— — - —  - 

From  failure  data 

m(i) 

mi 

Predicted  failures  in 
intervals 

(alpha/beta)*(EXP(-(beta*(i-s))))* 

(l-EXP(-(beta))) 

MSEf 

MSE 

MSE:  Cumulative 

Failures 

(SUM(((EVAL  f)-Xsir2))/((t-s)+l) 

MSE, 

MSEr 

MSE:  Remaining 

Failures 

SUM  (((EVAL  f)-Xt)^2)/((t-s)+l) 

MSEr 

MSEtf 

MSE:  Time  to  Failure 

(SUM(((EVAL  tf).-Tij)^2))/((J-s)) 

P(t) 

P 

Fraction  Remaining 
Failures 

(Rtt)/(EVAL  Ft) 

Q(t) 

Q 

Predicted  Program 

Quality 

(l-(EVALp)) 

Rc 

Remaining  Failures 
Criterion 

Given  value 
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r(t) 

r 

Predicted  remaining 
failures  using  Xt 

(alpha/beta)-(Xst) 

rW 

rt 

Predicted  remaining 
failures,  given  tt 

(alpha/beta)  *(EXP(-beta*  (tt-(s- 1 )))) 

None 

R 

Predicted  remaining 
failures  using  p 

p*(EVAL  Ft) 

None 

Rtt 

Number  of  remaining  failures 
in  computing  p  and  tt 

Given  value 

Ar(TF,t) 

dR 

Predicted  delta 

Remaining  Failures 

(alpha/beta)  *  (EXP(-(beta*  (i-(s- 1  )))))* 
(l-(EXP(-(beta*TR)))) 

RCM 

r(tt) 

riskR 

Risk  of  Remaining 

Failure 

((EVAL  rt)-Rc)/Rc 

RCM 

TfCO 

riskT 

Risk  of  Time  to  Failure 

(tm-(EVAL  tf))/tm 

s 

s 

First  failure  interval 

From  SMERFS 

t 

t 

Execution  time 

From  failure  data 

t, 

tt 

Predicted  Total  Test 

Time,  given  Rtt 

((LOG(alpha/(beta*  Rtt)))/beta)+(s- 1 ) 

TfW 

tf 

Predicted  Time  to  Failure 

(( 1  /beta)*  (LOG(alpha/(alpha-(beta*  (Xsi+F  ij )))))) 
-(i-(s-l)) 

TF(Ar,t; 

Tf 

Time  to  Failure  for  delta 
Remaining  Failures 

(- 1  /beta)*{LOG(l  -((beta/alpha)*(deltaR)* 
(EXP(beta*{i-(s-l))))))) 

T- 

u 

Tij 

Time  since  i  to  fail  at  j 

From  failure  data 

tm 

Time  to  Failure  Criterion 

Given  value 

Tf 

TR 

Given  Tf  for  Predicted 
delta  Remaining  Failures 

Given  value 

X3.1 

Xs 

Observed  failure  count  in 
the  range  [l,s-l] 

From  failure  data 

Xs,i 

Xsi 

Observed  failure  count  in 
the  range  [s,i] 

From  failure  data 

Xs,t 

Xst 

Observed  failure  count 
in  the  range  [s,t] 

From  failure  data 

X. 

Xt 

Observed  failure  count  in 
the  range  [l,t] 

From  failure  data 
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DISTRIBUTED  SYSTEM  MODEL  EQUATIONS 


NOTATION 
System  Nodes 

Number  of  Critical  Client  nodes 
N„5(t):  Number  of  Non-Critical  Client  nodes 
N„:  Number  of  Critical  Server  nodes 
N^(t):  Number  of  Non-Critical  Server  nodes 
N(t)=Njp+N„c(t)+N„+N,^(t):  Total  number  of  nodes 
Node  Failure  Probabilities 

Pec:  probability  of  a  software  defect  causing  a  critical  client  node  to  fail 

Pne:  probability  of  a  software  defect  causing  a  non-critical  client  node  to  fail 

Pcj:  probability  of  a  software  defect  causing  a  critical  server  node  to  fail 

p^:  probability  of  a  software  defect  causing  a  non-critical  server  node  to  fail 

Pj^:  probability  of  a  node  failure  due  to  software 

Node  Failure  Count 

i:  identification  of  an  interval  of  operating  time  of  the  software 

fcc(i):  critical  client  node  failure  count  in  interval  i 

f„c(i):  non-critical  client  node  failure  count  in  interval  i 

fcs(i):  critical  server  node  failure  coimt  in  interval  i 

f^(i):  non-critical  server  node  failure  count  in  interval  i 

d(i):  total  defect  count  in  interval  i 

D:  total  defect  count  across  all  intervals 

Types  of  Software  Defects  (Examples  Only) 

S:  Software  Defect 
G:  General  Protection  Fault 
N:  Network  Related  Defect 
C:  System  Crash 

System  Failure  Probability  Components 

t:  cumidative  time  in  the  range  [l,t];  last  interval  of  observed  failure  data;  current  interval 

Pj^:  probability  that  one  or  more  critical  clients  N^^  fail,  given  that  the  software  fails 
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P„,(t):  probability  that  all  non-critical  clients  N„<,(t)  have  failed  by  time  t,  given  that  the  software  fails 

pcs:  probability  that  one  or  more  critical  servers  N„  fail,  given  that  the  software  fails 

P„5(t):  probability  that  all  non-critical  servers  N^(t)  have  failed  by  time  t,  given  that  the  software  fails 

System  Failure  Probability 

Pjyj/node  fails  (t):  probability  of  a  system  failure  by  time  t,  given  that  a  node  fails 
EQUATIONS  IMPLEMENTEP  USING  DEFECT  CONTROL  SYSTEM  DATABASE  i^mples  OnM 
Node  Failure  Count 

fcc(I)=COUNT  as  failures  WHERE  (SAGANA/iotC)  in  interval  I 
f„(,(I)=COUNT  as  failures  WHERE  (SAGA770tNA«olC)  in  interval  I 
f„(I)=COUNT  as  failures  WHERE  (SAwotGANAC)  in  interval  I 
fn5(I)=COUNT  as  failures  WHERE  (SA«otGAnotNAC)  in  interval  I 
d(I)=total  defect  count  in  interval  I 
D=Zid(I) 

EQUATIONS  IMPLEMENTED  USING  WINDOWS  CALCULATOR 
Node  Failure  Probabilities 

Probability  of  a  software  defect  causing  a  critical  client  node  to  fail: 

Probability  of  a  software  defect  causing  a  non-critical  client  node  to  fail: 

p,.=EiUi)® 

Probability  of  a  software  defect  causing  a  critical  server  node  to  fail: 
rc==I4(I)» 

Probability  of  a  software  defect  causing  a  non-critical  server  node  to  fail: 

p..=£,4a)/D 

Probability  of  a  node  failure  due  to  software: 

Psw=Pcc+Pnc+PCs+Pns 

System  Failure  Probability  Components 

Probability  that  one  or  more  critical  clients  fail,  given  that  the  software  fails: 

Pcc=l-(1-Pccf“ 

Probability  that  all  non-critical  clients  N„<,(t)  have  failed  by  time  t,  given  that  the  software  fails: 

Pn.W'CPj"'”" 
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Probability  that  one  or  more  critical  servers  fail,  given  that  the  software  fails: 
Pcs=l-(1-Pcsf^^ 

Probability  that  all  non-critical  servers  N^(t)  have  failed  by  time  t,  given  that  the  software  fails: 

Pns(t)=(pJ^“W 

EQUATION  IMPLEMENTED  TN  STATGRAPHICS 
System  Failure  Probability 

Probability  of  system  failure,  by  time  t,  given  a  node  failure: 
P>odefails(t)=[PJ[P„(t)]+[PJ[P„(t)]= 


Probability  of  Client  Failure  Probability  of  Server  Failure 
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TABLE  2:  STATGRAPHICS  (SGPLUS)  EQUATION  IMPLEMENTATIONS 
DISTRIBUTED  SYSTEM  MODEL  EQUATIONS 

Math 

Notation 

Sgplus 

Notation 

Statgraphics 

Definition 

Sgplus  Function 

Ncc 

Ncc 

Number  of  critical 
clients 

From  system  configuration  (constant) 

N„e(t) 

Nnc 

Number  of 
non-critical  clients 

From  system  configuration  (vector  as  a 
function  of  time) 

Ncs 

Ncs 

Number  of  critical 

servers 

From  system  configuration  (constant) 

N„(t) 

Nns 

Number  of 
non-critical  servers 

From  system  configuration  (vector  as  a 
fimctionof  time) 

Pcc 

pcc 

Probability  of  critical 
client  failure 

From  Windows  Calculator 

Pnc(t) 

pnc 

Probability  of  non- 
critical  client  failure 

From  Windows  Calculator 

Pcs 

pcs 

Probability  of  critical 
server  failure 

From  Windows  Calculator 

Pns(t) 

pns 

Probability  of  non- 
critical  server  failure 

From  Windows  Calculator 

Psy/node 

fails(t) 

Psys 

Probability  System 
Failure/Node  Failure 

((1  -(l-pcc)^Ncc)*((pnc)'^Nnc))+ 
((l-(l-pcs)^Ncs)*((pns)^Nns)) 

EQUATION  IMPLEMENTED  IN  SMERFS 
Time  to  Failure  Prediction 

Predicted  time  for  the  next  F,  failures  to  occur,  when  the  current  time  is  t,  for  each  of  the  four  types  of  node 
failures:: 

T,(t)=[(log[a/(a-P(X^..F.)])/p]-(t-s4) 
for  (a/p)>(X^,.F,) 
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METRICS  MODELS  EQUATIONS 


DISCRIMINATIVE  POWER  VAT  JDATION  MODET, 

NOTATION 
Defined  in  Table  3. 

EQUATIONS  IMPLEMENTED  IN  STATGRAPHICS 

Maximum  vertical  difference  between  the  CDFs  of  two  samples  (e.g.,  the  CDFs  of  My  for  drcomt^F^  and 
drcounf>FJ: 

K-S(M,j)=max{[CDF(My/(Fi<F,)]-[CDF(My/(F>F,)]} 

Module  count,  based  on  BDFs  of  Fj  and  My,  that  are  calculated  over  the  n  modules  for  m  metrics: 
C„=COUNT  FOR  ((Fj^F)A(M,^M^.)..A(M.^M^.)--.A(M„^MJ) 

i-1 

C,,=COlW  FOR  ((F.^F;A((M  >M^,)...V(M,.>M^...V(M^>MJ)) 
q.=COUNT  FOR  ((F>F;A(M,^M^.)..A(M„.M^)...A(M^.MJ) 

i.l 

C^^^COUNT  FOR  ((F>F>((M >M^.)..V(M>M.)..V(M^>MJ)) 

i-1 

Proportion  of  Type  1  Misclassifications: 

Pi=C2,/n 

Proportion  of  Type  2  Misclassifications: 

P2=Ci2/n 

Proportion  of  Type  1+Type  2  Misclassifications; 

P 1 2~(^2 1  "*'C'  1 

Proportion  of  low  quality  (i.e.,  drcount>0)  software  correctly  classified: 

LQC=C22/n2 
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Remaining  Factor  RF  (e.g.,  remaining  drcount).  This  is  the  sum  of  Fj  not  caught  by  inspection; 
for  (F>F^)A(M„^M^,)...A(M„^M.)...A(M^^MJ) 

Proportion  of  RF,  where  TF  is  the  total  Fj  prior  to  inspection: 

RFP=RF/TF 

tf^Ef 

i-1 

Density  of  RF: 

RFD=RF/n 

Proportion  of  modules  remaining  that  have  Fi>Fc: 

RMP=RFM/n, 
where  RFM  is  given  by: 

RFM=COUNT  FOR  ((F>0)A(M,^M^,)...A(M-iM^)...A(Mj„$M^)) 

i-1 

Proportion  of  modules  that  must  be  inspected: 

I=(Ci2+C22)/n 

Wasted  inspection; 

RI=C22/C.2 

EQUATION  IMPLEMENTED  USING  WINDOWS  CALCULATOR 

Quality  Inspection  Ratio: 

QIR=(  IaRFP  l/RFPi)/(AI/Ii) 
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TABLE  3:  STATGRAPHICS  (SGPLUS)  AND  WINDOWS  CALCULATOR  EQUATION 

IMPLEMENTATIONS 

SOFTWARE  METRICS  MODELS  EQUATIONS 

DISCRIMINATIVE  POWER  VALIDATION  MODEL 

Math 

Notation 

Sgplus 

Notation 

Statgraphics  Definition 

Sgplus  Function 

Cji 

Cll 

Module  count  for  Cl  1 

SUM  ((drcount  LE  Dc)  AND  (Ml  LE  Mlc)  AND  (M2 

LE  M2c)  AND  (M3  LE  M3c)  AND  (M4  LE  M4c)  AND 
(sample  EQ  Ss)) 

Ci2 

C12 

Module  count  for  C 12 

SUM  ((drcount  LE  Dc)  AND  ((MI  GT  Mlc)  OR  (M2 

GT  M2c)  OR  (M3  GT  M3c)  OR  (M4  GT  M4c))  AND 
(sample  EQ  Ss)) 

C21 

C21 

Module  count  for  C21 

SUM  ((drcount  GT  Dc)  AND  (Ml  LE  Mlc)  AND  (M2 

LE  M2c)  AND  (M3  LE  M3c)  AND  (M4  LE  M4c)  AND 
(sample  EQ  Ss)) 

^22 

C22 

Module  count  for  C22 

SUM  ((drcount  GT  Dc)  AND  ((Ml  GT  Mlc)  OR  (M2 

GT  M2c)  OR  (M3  GT  M3c)  OR  (M4  GT  M4c))  AND 
(sample  EQ  Ss)) 

Fc 

Dc 

Quality  factor  critical  value 

Given  value 

Fi 

drcount 

(example) 

Vector  of  quality  factor 
values 

From  quality  factor  data 

I 

I 

Proportion  of  modules 
that  must  be  inspected 

(((EVALC12)+(EVALC22))/n)*100  % 

AI 

None 

Difference  in  two  successive 
values  of  I 

Windows  Calculator  computation 

i 

Module  name 

Module  index 

From  metrics  file 

j 

Metric  name 

Metric  index 

From  metrics  file 

K-S(M,j) 

maxcdfdiff 

Maximum  vertical  difference 
between  two  CDFs 

MAX  (EVAL  (cdfdifif)),  where  cdfdiff= 
(ABS(ml-m2))/100  &  ml,  m2=metric  vectors 

LQC 

LQC 

Proportion  of  low  quality 
software  correctly  classified 

((EVAL  C22)/(EVAL  n2))*  1 00  % 

Mej 

Mlc...M4c 

Vector  of  j  metric 
critical  values 

From  metrics  data  and  K-S  test 

Mij 

M1...M4 

Matrix  of  modules  and 
metrics 

From  metrics  data  and  K-W  test 

N: 

N1 

Count  of  accepted 
modules 

SUM  ((Ml  LE  Mlc)  AND  (M2  LE  M2c)  AND  (M3  LE 
M3c)  AND  (M4  LE  M4c)  AND  (sample  EQ  Ss)) 
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N2 

N2 

Count  of  rejected 
modules 

SUM  (((Ml  GT  Mlc)  OR  (M2  GT  M2c)  OR  (M3  GT 
M3c)  OR  (M4  GT  M4c))  AND  (sample  EQ  Ss)) 

n 

n 

Number  of  modules  in  sample 

Given  value 

ni 

nl 

Count  of  high  quality  modules 

(EVALC11)+(EVALC12) 

112 

n2 

Count  of  low  quality  modules 

(EVAL  C21)+(EVAL  C22) 

Pi 

PI 

Proportion  of  Type  1 
misclassifications 

((EVALC21)/n)*100  % 

P2 

P2 

Proportion  of  Type  2 
misclassifications 

((EVAL  C12)/n)*  100  % 

^12 

P12 

Proportion  of  Type  1+Type  2 
misclassifications 

(((EVAL  C12)+(EVAL  C21))/n)*  100  % 

QIR 

None 

Quality  Inspection  Ratio 

Windows  Calculator  computation 

RF 

RF 

Remaining  Quality 

Factor 

SUM  (drcount  SELECT  ((Ml  LE  Mlc)  AND  (M2  LE 
M2c)  AND  (M3  LE  M3c)  AND  (M4  LE  M4c)  AND 
(drcount  GT  Dc)  AND  (sample  EQ  Ss))) 

RFD 

RFD 

Density  of  RF 

(EVAL  RF)/n 

RFP 

RFP 

Proportion  of  RF 

((EVAL  RF)/(EVALTF))*  100  % 

ARFP 

None 

Difference  in  two  successive 
values  of  RFP 

Windows  Calculator  computation 

RFM 

RFM 

Count  of  modules  with 
Remaining  Quality 

Factor 

SUM  ((drcount  GT  Dc)  AND  (Ml  LE  Mlc)  AND  (M2 

LE  M2c)  AND  (M3  LE  M3c)  AND  (M4  LE  M4c)  AND 
(sample  EQ  Ss)) 

RMP 

RMP 

Proportion  of  RFM 

((EVAL  RFM)/n)*  100  % 

RI 

RI 

Wasted  Inspection  . 

(EVAL  C22)/(EVAL  Cl  2) 

None 

Ss 

Sample  Identification 

Given  value 

TF 

TF 

Total  Quality  Factor 

SUM  (drcotmt  SELECT  sample  EQ  Ss) 

X^c 

Critical  value  of  Chi-Square 

Function  of  Cl  1,  C12,  C21,  and  C22 
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PREDICTABILITY  VALIDATION  MOfiFT 
NOTATION 

Defined  in  Table  4 

EQUATIONS  IMPLEMENTED  IN  STATGRAPHICS 

Proportion  of  modules  with  Fj>0  in  the  Validation  Sample  prior  to  inspection  and  correction  of  defects: 
p„=(COUNT  FOR  F.>0)/n, 

i-l  ‘ 

Two-sided  confidence  limits  of  p„,  used  as  predicted  limits  of  p„'  in  the  Application  Sample: 

CLp„=p±Z^ 

Proportion  of  modules  not  flagged  for  inspection  (i.e.,  contained  in  N,)  with  Fi>0  in  the  Validation  Sample: 
pN,=RFM/Ni 

One-sided  upper  confidence  limit  of  pN„  used  as  predicted  limit  of  pN/  in  the  Application  Sample: 
ULpN,=pN,^Z 

Proportion  of  modules  flagged  for  inspection  (i.e.,  contained  in  Nj)  with  Fi>0  in  the  Validation  Sample: 
pN2=((pJ(n)-(RFM))/N2 

One-sided  lower  confidence  limit  of  pNj,  used  as  predicted  limit  of  pNj'  in  the  Application  Sample: 
LLpN,=pN2-Z 

Proportion  of  quality  factor  that  occurs  on  modules  not  flagged  for  inspection  (i.e.,  contained  in  N,)  in  the 
Validation  Sample: 

d,=RF/TF  (same  as  RFP  if  RFP  is  expressed  as  a  proportion) 

One-sided  upper  confidence  limit  of  d,,  used  as  predicted  limit  of  d,'  in  the  Application  Sample 


Proportion  of  quality  factor  that  occurs  on  modules  flagged  for  inspection  (i.e.,  contained  in  Nj)  in  the 
Validation  Sample: 

d,=l-d, 

One-sided  lower  confidence  limit  of  dj,  used  as  predicted  limit  of  dj'  in  the  Application  Sample: 


LLd,=d,-Z, 


TF 


Expected  quality  factor  count  (e.g.,  drcount)  that  occurs  on  modules  not  flagged  for  inspection  (i.e., 
contained  in  N,')  in  the  Application  Sample: 


D,=(RF/N,)(N/) 

Expected  quality  factor  count  (e.g.,  drcount)  that  occurs  on  modules  flagged  for  inspection  (i.e.,  contained 
in  Nj')  in  &e  Application  Sample): 

D2=((TF-RP)/N,)(N2') 
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TABLE  4:  STATGRAPHICS  (SGPLUS)  EQUATION  IMPLEMENTATIONS 

SOFTWARE  METRICS  MODELS  EQUATIONS 

PREDICTABILITY  VALIDATION  MODEL 

Math 

Notation 

Sgplus 

Notation 

Statgraphics  Definition 

Sgplus  Function 

Pn 

pn 

Proportion  of  modules  with 

Fi>0 

(SUM((drcount  GT  0)  AND  (sample  EQ  Ss)))/n 

CLp„ 

CLpn 

Two-sided  confidence  limits 
of  pn 

((EVAL  pn)+(Z*(SQRT  (((EVAL  pn)* 
(l-(EVALpn)))/n)))) 

pN, 

pNl 

Proportion  of  modules  not 
flagged  for  inspection 

(EVAL  RFM)/(EVAL  Nl) 

ULpN, 

ULpNl 

Upper  Confidence  limit  of 
pNl 

((EVAL  pNl)+(Z*(SQRT  (((EVAL  pNl)* 

(1-(EVAL  pNl)))/(EVAL  Nl))))) 

pN, 

pN2 

Proportion  of  modules 
flagged  for  inspection 

((n*(EVAL  pn))-(EVAL  RFM))/(EVAL  N2) 

LLpNj 

LLpN2 

Lower  confidence  limit  of 
pNl 

((EVAL  pN2)-(Z*(SQRT  (((EVAL  pN2)* 

(1-(EVAL  pN2)))/(EVAL  N2))))) 

di 

dl 

Proportion  of  quality  factor 
count  that  occurs  on  modules 
not  flagged  for  inspection 

(EVAL  RF)/(EVAL  TF) 

ULd, 

ULdl 

Upper  confidence  limit  of  dl 

((EVAL  dl)+(Z*(SQRT  (((EVAL  dl)* 

(EVAL  d2))/(EVAL  TF))))) 

d. 

d2 

Proportion  of  drcount  that 
occurs  on  modules  flagged 
for  inspection 

(1-EVAL  (dl)) 

LLdj 

LLd2 

Lower  confidence  limit  of  d2 

((EVAL  d2)-(Z*(SQRT  (((EVAL  dl)* 

(EVAL  d2))/(EVAL  TF))))) 

D, 

Dl 

Expected  quality  factor  count 
that  occurs  on  modules  not 
flagged  for  inspection 

((EVAL  RF)/(EVAL  Nl))*Nla 

D, 

D2 

Expected  quality  factor  count 
that  occurs  on  modules 
flagged  for  inspection 

(((EVAL  TF)-(EVAL  RF))/(EVAL  N2))*N2a 

N,' 

Nla 

Count  of  accepted  modules  in 
Application  Sample 

SUM  ((Ml  LE  Mlc)  AND  (M2  LE  M2c)  AND  (M3  LE 
M3c)  AND  (M4  LE  M4c)  AND  (sample  EQ  Ss)) 

n; 

N2a 

Count  of  rejected  modules  in 
Application  Sample 

SUM  (((Ml  GT  Mlc)  OR  (M2  GT  M2c)  OR  (M3  GT  M3c) 
OR  (M4  GT  M4c))  AND  (sample  EQ  Ss)) 

Z. 

Z 

Standardized  difference 
between  variable  and  mean  of 
normal  distribution 

Given  value  based  on  choice  of  a 
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